Information-theoretic thresholds from the cavity method
نویسندگان
چکیده
منابع مشابه
Information-theoretic thresholds for community detection in sparse networks
We give upper and lower bounds on the information-theoretic threshold for community detection in the stochastic block model. Specifically, let k be the number of groups, d be the average degree, the probability of edges between vertices within and between groups be cin/n and cout/n respectively, and let λ = (cin − cout)/(kd). We show that, when k is large, and λ = O(1/k), the critical value of ...
متن کاملInformation Theoretic Text Classification Using the Ziv-Merhav Method
Most approaches to text classification rely on some measure of (dis)similarity between sequences of symbols. Information theoretic measures have the advantage of making very few assumptions on the models which are considered to have generated the sequences, and have been the focus of recent interest. This paper addresses the use of the Ziv-Merhav method (ZMM) for the estimation of relative entr...
متن کاملInformation-Theoretic Indistinguishability via the Chi-Squared Method
Proving tight bounds on information-theoretic indistinguishability is a central problem in symmetric cryptography. This paper introduces a new method for information-theoretic indistinguishability proofs, called “the chi-squared method”. At its core, the method requires upperbounds on the so-called χ2 divergence (due to Neyman and Pearson) between the output distributions of two systems being q...
متن کاملLearning from Examples with Information Theoretic Criteria
This paper discusses a framework for learning based on information theoretic criteria. A novel algorithm based on Renyi’s quadratic entropy is used to train, directly from a data set, linear or nonlinear mappers for entropy maximization or minimization. We provide an intriguing analogy between the computation and an information potential measuring the interactions among the data samples. We als...
متن کاملApplication of an information-theoretic method for efficacy assessment.
An information-theoretic pattern recognition method was used to construct descriptive models of data related to 1,674 radioisotope lung scan referrals for the purpose of assessing lung scan influence on diagnosis and management of pulmonary embolism. It was observed that, relative to other clinical information available prior to the scan, the lung scan significantly improved the ability of the ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Advances in Mathematics
سال: 2018
ISSN: 0001-8708
DOI: 10.1016/j.aim.2018.05.029